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ABSTRACT 



The performance of the graduate 
Kansas State Collegers teacher education progra 
their 'employer? to determine the adequacy of th 
and secondary education programs. The Kansas St 
Education developed two questionnaires, one con 
performance-related items for rating elementary 
the Oi-her consisting of 12 items for rating sec 
teachers. Using a four-point scale, principals, 
district heads completed questionnaires for 39 
teachers and 21 elementary school teachers. The 
that a) secondary school teachers attained a me 
of a possible 48; b) elementary school teachers 
44.14 out of a possible 64; c) 92.1% of seconda 
were recommended for employment; and d) 95.3% o 
teachers were recommended for employment. It ap 
products of Fort Hays State Collegers teacher e 
well prepared in relation to their peers. Howev 
the sample limits the study, and findings shoul 
tentative unt.il they are validated. Further res 
include a) a replication of this study with a s 
state colleges ira Kansas and b) a combined teac 
which evaluations of teachers are compared with 
employers. (HMD) 
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Considerable research has been conducted on the adequacy of college 
programs in the preparation of graduates for their chosen occupation. 
However, much of this research has been based upon self-report. This is 
an important dimension to be measured In the evaluation of occupational 
preparation. Another dimension of equal importance, particularly among 
recent graduates, is the evaluation by their respective employers of the 
graduates' preparation. The perception of the adequacy of preparation may 
differ between these respective observers. 

In the past, it has been commonly assumed that there Is a direct 
relationship between academic achievement in college and occupational 
success. The ultimate criterion for judging many different professional 
programs in colleges is whether they produce competent graduates who enter 
the professions and perform effectively. 

The Kansas Master Planninrj Commission of Postsecondary Education has 
attempted recently to evaluate the preparation of students and graduates 
of the six Kansas colleges and universities under the Board of Regents. 
The evaluation was conducted at two critical points: graduates of the 
class of 1967 and seniors enrolled In the Spring of 1972. (State of Kansas, 
1972a and 1972b) These studies provided self-evaluation when students were 
completing their programs of study and after they had entered their chosen 
profession or vocation. 

Recently there has been some emphasis on making evaluations of 
performance based upon the attainment of behavioral objectives by the 
subjects under evaluation. Tne oojectives of a particular program of 
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study — once they have been identified and stated — can be used as the 

basis for the evaluation of a program by measuring the students' attainment 

of them. 

The purpose of this study is for employers to evaluate the attainment 
of behavioral objectives of students who are products of the teacher educa- 
tion program at Fort Hays Kansas State College. This is a pioneer effort. 
Other studies have asked for a self-report of students who wish to become 
certified teachers. Thi<; has been conducted upon completion of the 
"teaching block.'* In addition, employers have been asked to rate teachers 
in terms of the adequacy of their preparation and success as a teacher 
(Fort Hays Kansas State College, 1971). However, behavioral objectives 
were not used as s criteria for employers measuring success or adequacy 
of preparation. 

Procedure 

Sample 

Subjects were chosen from the senior classes of 1970 and 1971 vho, 
according to Alumni Office records, listed their occupation as either an 
elementary or secondary teacher. A total of 486 persons were identified 
as reporting to be employed in a Kansas teaching position. Persons 
teaching outside of Kansas were eliminated from the study since the vast 
majority of teaching graduates begin initial employment in the State. 

Using a random number table, a 20 percent (N=97) sample was initial ly 
chosen. It was hoped that a final sample in excess of 10 percent would be 
Identified so thct a meaningful sample size could be obtained based upon 
an expected response rate of approximately 80 percent. Since it was hoped 
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to obtain a representative sample by teaching field from the secondary 
school teachers, some manipulation of the original 20 percent sample was 
necessary. It was hoped to obtain a final sample of secondary teachers 
which was proportional to the total number of FHKSC graduates who were 
cert.ified to teach in a particular teaching field, i.e., their major 
field of study. It was assumed that the recent graduates would be teaching 
in their major field. It was realized that this might not always be a 
va I id assumption. 

Table 1 shows the distribution by major field of study of 1970 and 
1971 teacher education graduates who were certified to teach. The secondary 
sample was manipulated randomly to conform generally to this distribution. 

Table I 

Description of Major Field of Graduates Certified 
to Teach in 1970 and 1971 



N 



1970 



Percent 



N 



1971 



Percent 



Elementary Education 
Seconlary Education 

Art 

Bus i ness 
Eng I ish 
Speech 
Ge rman 
Latin 
Spanish 

Home Economics 
Industrial Arts 
Mathemati cs 
Mus i c 

Physical Education 
General Science 
Biology 
Chemi stry 
Physics 

Social Sciences 
Hi story 
Econ/Soc/Psych 
Special Education 

TOTAL 



219 
263 

21 
26 
32 
I 
1 

0 
8 
14 
18 

25 
7 

30 
8 
8 
0 
0 
0 

44 
2 
17 

481 



45.5 
54.5 

4.4 
5.4 
6.7 
.2 
.2 

0 

I .7 

2.9 

3.7 

5.2 

1.5 

6.2 

1.7 

I .7 

0 

0 

0 

9.1 
.4 
3.5 

100.0 



208 
259 

24 
30 
21 
9 
I 
I 

6 
14 
28 
13 
16 
44 

1 

8 
I 
I 

2 
17 

2 
20 

467 



44.5 
55.5 

5. 1 
6.4 
4.5 
1.8 
.2 
.2 
1.3 
3.0 
6.0 
2.8 
3.4 
9.4 
.2 
1.7 
.2 
.2 
.4 
3.6 
.4 
4.3 

99.6 
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After manipulation of the Initial 20 percent sample of secondary 
teachers, 82 subjects were identified as meeting the criteria established 
for inclusion in the final sample. Questionnaires were mailed to the 
employers of these teachers, 

I nstruments 

The Department of Education was asked to develop a set of objectives 
which they hoped teachers, prepared at Fort Hays State, would acquire wh i le 
a student. Two sets of objectives were prepared — one for students enrolled 
in the elementary education program and one for students enrol led in the 
secondary education program. Sixteen objectives were developed for 
elementary education and twelve objectives were developed for secondary 
education. The evaluator (superintendent or principal) was asked to rate 
the suDject teacher on the attainment of each objective according to the 
following scale: excellently 4; well 3; average 2; fair I ; or No Information 
0. 

All questionnaires were sent to the Superintendent of Schools for the 
Unified School District in which the subject had taught during 1971-72, 
according to records of the Alumni Office. A cover letter with instructions 
for referral of the questionnaire, if necessary, accompanied each question- 
naire as did an addressed stamped envelope. Provision was made for 
identifying the subject field(s) taught in the case of secondary teachers. 
In the event additional follow-up information was needed, the following 
additional questions were asked: 

If this person did not teach in your school district during 1971-72, please 

check here and return: If you know what USD this person taught in, please 

list the number . 

I would recommend him or her for employment: YES No . 

Person has signed a contract for the 1972-73 year in your district: YES 

NO . 

O 
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Results 

Eighty-three percent (N=68) of the questionnaires were returned. 
Eight of the 68 had to be discarded because of inaccurate information 
regarding the teaching location or because the individual responding had 
no information on which to form a judgment. A. ter exclusions and non- 
returned questionnaires, a sample of 12 percent of the total number of 
persons who reported to have teaching positions formed the basis for the 
study. No follow-up was made on the non-returnccj questionnaires. 

Table 2 summarizes the employers' ratings on the attainment of 
behavioral objectives by FHKSC secondary education graduates of 1970 and 
1971. Any rating of "0" was considered not applicable and was not 
figured in the calculations, A copy of the complete instrument is shown 
in Appendix A. 

Table 2 



Ratings of Objectives for Secondary Teachers 

N=39 









Percent 




Mean 


SO 


Below 2 


Institutional Behavior 


2.78 


.89 


7.6 


Behavior Changes 


2.58 


.89 


7.6 


Communication Skills 


3. 10 


.68 


2.5 


External Behavior 


2.72 


.97 


12.8 


Subject Competency 


3.34 


.85 


5.1 


Evaluative Procedures 


2.79 


.92 


5.1 


Sense of Humor 


3.03 


.78 


5.1 


Classroom Control 


3. 17 


.97 


10.3 


Responds to Criticism 


3.23 


.81 


5. 1 


1 n i t i at i ve/Creat i v i ty 


3.54 


.85 


2.5 


1 nnovati ve 


3. 10 


.85 


5.i 


Abi 1 ity to Fit 


3 J8 


.85 


5. 1 
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The overall mean score on the attainment of all objectives for 
secondary teachers was 35,87 with a standard deviation of 7.64. The 
highest possible score was 48. This represents an average rating of 
2.99 on each objective. 

In response to the questions concerning recommending the teacher 
for employment, 92.31 percent of the employers Indicated a positive 
response. Regarding the question of employment for 1972-73, 76.93 
percent of the secondary teachers had signed a contract to remain in the 
same district in which they had taught during 1971-72. No information 
was obtained on those who had not signed a contract. 

The distribution of the ratings on secondary teachers appeared to 
be skewed to the right in all cases indicating above average ratings. 
This was a limitation of the scale used. 

More comments concerning the subjects were received from the 
secondary teacher evaluations than from the elementary teacher evalua- 
tions. One principal wrote of a subject that he was "a very fine younq 
teacher. Send us more just like him." Another evaluator commented 
that . . was the best first year teacher I ever supervised. If all 
of your graduates are trained as well as she, you are doing an excellent 
job." Finally, one principal wrote a philosophical discourse on the 
limitations brought about by lack of more teaching experience. He felt 
that the "halo effect" of the supervising teacher often handicapped the 
student teacher in "establishing a wholesome classroom atmosphere." 

Table 3 summarizes the employers^ ratings of the attainment of 
behavioral objectives by elementary education graduates of 1970 and 1971. 
A copy of the complete instrument is shown in Appendix B. 

O 

EKLC 
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Tnble 3 

Ratings of Objectives for Elementary Teachers 

N=?l 



Percent 





Mean 


SD 


Be low 


Subject Knowledge 


3.00 


.77 


4.7 


Growth Characteristics 


3.04 


.65 


0 


School as Institution 


2.95 


.82 


0 


LearninvT Theories 


2.61 


.74 


4.7 


Lesson-p 1 an Skills 


2.80 


.74 


4.7 


Attainment of Goals 


2.61 


1 .02 


4.7 


Communication Skills 


2.80 


.98 


0 


Behavior Prob 1 ems 


2.85 


.91 


14.2 


Appropriate Methods 


2.75 


.71 


9.5 


Methods-courses Uti 1 ization 


2.42 


.96 


4.7 


Uti 1 izes Research 


2.38 


1 .24 


4.7 


Utilizes Evaluative Tools 


. 2.85 


.85 


0 


Understanding of School Organization 


2.90 


.64 


9.5 


Student Records 


3.24 


.85 


4.7 


Library Use 


2.42 


i .20 


0 


Cooperation 


3.33 


1.0! 


9.5 



The elementary teachers received an overall mean score on the attainment 
of all objectives of 44.14 with a standard deviation of 10*37. The highest 
possible score was 64. This represents an average rating of 2.76 for each 
objective. 

For the elementary teachers, 95.3 percent of the employees indicated 
that they would .'ecommend the teacher evaluated. All of the elementary 
teacher sample had signed contracts to remain in the same district for the 
1972-73 year. 

The distribution of the ratings on elementary teachers appeared to be 
skewed to the right indicating above average ratings. However, this was to 
a lesser degree in the case of the eler:»entary teachers than v-ith the secondary 
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teachers. From a cursory inspection of the distribution of the scores, it 
was apparent that very low evaluation of one elementary school subject 
affected the overal I rating. Comments on this subject's questionnaire 
substantiated the low rating but the evaluator added that, "The responses 
on this questionnaire do not reflect on Hays College as a teacher prepara- 
tion school 

Generally the other comments by evaluators were positive. However, 
one principal commented that, '*Hays graduates appear to be weak in audio- 
visual techniques in presenting material." 

Pi scussion 

Limitations 

Limitations of this study include the smallness of the sarrple and the 
restricting of subjects to those teaching in Kansas. Subjects were limited 
to 1970 and 1971 graduates. It was anticipated that the effect of the 
adequacy of a college program is a function of time, and that the longer 
a person had been out of college the less effect preparation would have on 
performance. A two year restriction on the sample may have been too severe 
a criterion. 

With the job market such as it is, it is evident from the college's 
records +hat: (I) many students who took the teaching block or who majored 
in elementary education did not apply for certification, and (2) some students 
who wanted teaching positions could noi' find employment in Kansas. 

No normalized ratings on a'Vtainment of objectives were aval lable to 
compare against the obtained scores. Furthermore, it appeared that some 
evaluators applied different standards or criteria to the ratings of excellent, 
well, average, or fair. 
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The clarity and preciseness of the stated objectives was not studied 
outside of the Department of Education. No pre-test of the instrument was 
conducted. 

In some cases the distributions of the ratings was skewed. It would 
have been more desirable to have a rating scale in which a more normal 
distribution could have been obtained. No inter-correlations between the 
objectives were obtained. It is hoped that this can be done in the future. 

The severe limitation of the correctness and completeness of alumni 
records hindered the study. Without contacting the teacher directly for 
employment data, the self-report data from the Alumni Office must be used. 
Many alumni do not keep their records up to date even though a concerted 
effort is made by the Alumni Office to keep their records current. 

Other restrictions apply to the population for whom the study is 
applicable. It applies only to bachelor degree graduates of Fort Hays 
Kansas State Col lege who have beer, out of college for one or two years and 
who '^eported where they were teaching. 

The findings of this study were generated from a single sample. Without 
true validation they should be considered as tentative. 

Within those limitations it is possible to discuss the fol lowing points. 

Cone! us ions 

It appears that the products of Fort Hays State College's teacher 
education program are well prepared in relation to their peers. It appears 
that the secondary teachers have attained their behavioral objectives to a 
greater degree than the elementary teachers. However, both groups were 
rated well above average. 
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There was considerably more variance in the ratings of the elementary 
teachers. Four objectives scores had a standard deviation greater than 
1.0. This may be a function of sample size, ihe very low rating of one 
subject, the variation in rating standards used by evaluators, or varia- 
tion in the attainment of particular objectives by these teachers. 

The absence of turnover (non-reemployment) in the elementary teachers 
Indicates a high degree of satisfaction between both the teachers and their 
superintendents. Evidently there is less satisfaction, more mobility, or 
more attrition among the secondary teachers than the elementary teachers. 
The non-recommendation rate of the secondary teachers was two-thirds greater 
among secondary evaluators than elementary evaluators. This further supports 
the greater degree of satisfactory relationships between teachers and their 
employers at the elementary level. 

ImpI i cations 

A careful review of the stated behavioral objectives is in order. 
Students, faculty, and employers need to evaluate these objectives in terms 
of their respective needs and goals. With an attempt to recruit students 
from eastern Kansas and outside of Kansas, it w5 II be necessary to analyze 
whether these objectives are satisfactory and equally applicable to schools, 
students, parents, and administrators outside of the Western Kansas rural, 
small school environment. 

Students need to be queried as to their knowledge of these objectives 
upon entering the teacher education program. 

It Is desirable to replicatf^ this study with a sample from the three 
state colleges in Kansas. Presumably there would be some commonality as 
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to the objectives desired by all teacher education programs. The refining 
of 1ho rating i:>Coles dod objectives is needed and the validity of the rating 
^scales need to be established. 

Finally, a similar or combine^' teacher-employer study needs to be conducted 
in which evaluations from the teachers themselves are compared with those of 
thei r emp loyers. 



REFERENCES 



fort Hays Kansas State College. 1971. Follow-Up Study 1971. A 
Study of the Classes of^l964, 1967, and 1970. Compiled by 
. the Office of the Uean of the Faculty, Departmenr of Education, 
and Placement Office. Hays, Kansas. 

State of Kansas Master Planning Cotnmi ssion . 1972a. An Appraisal of 
the Quality of Education Received by the 1972 Seniors at the 
Six Colleges and Universities under the Kansas Board of Regents. 
Planning Report Number 4. August, 1972. 

State of Kansas Master Planning Commission. 1972b. An Appraisal of 
the Quality of Education Received by the 1967 Graduates of the 
Six College?; and Universities under the Kansas Board of Regents. 
Planning Report Number 5. September, 1972. 



APPENDIX A 



-13- 



Director of Institutional Research 



FORT HAYS KANSAS STATE COLLEGE 

HAYS, KANSAS 67601 



Telephone 913 628-5880 




June 14, 1972 



Dear Kansas School Administrator: 

In order that the teachers prepared at Fort Hays Kansas State College will 
continue to be among the best-qualified, we are conducting a study to eval- 
uate the teacher- training program at our institution. Enclosed you will 
find a one and one-half page questionnaire and check list. We would appre- 
ciate your taking a few minutes to complete and return it in the enclosed, 
stamped envelope within the next few days and no later than July 1. 

To make this evaluation, a random sample of graduates in elementary or sec- 
ondary education were chosen so that we might contact the school systems in 
which they were employed for the 1971-72 school year. Our records indicate 
the person named on the enclosed evaluation sheet taught at your school or 
within your school system during the past year; we are asking your help in 
determining the level of performance exhibited by this person. 

If you cannot personally give such an evaluation, we ask that the evaluation 
sheet be given to that administrator who supervises the teacher and knows 
the quality of his or her work. If, in fact, the person did not teach with- 
in the school system, please so indicate on the next page and return the 
questionnaire to us. 

We hope to use the results of the evaluation to improve current programs and 
to make plans for future program development. 

Your responses will be kept confidential and only the summary of responses 
from all graduates will be published. 

Tliank you for your time and effort. Without your help and the information 
only you can afford us, it would De impossible to complete the evaluation. 

Sincerely, 



Michael 0. Stewart 

Director of Institutional Research 





Department of Education 
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FORT KAYS KANSAS STATE COLLEGE 
Department of Education 
Office of Institutional Research 



RATING SCALE FOR TEACHER EDUCATION PROGRAMS 
Secondary Education 



Name_ . . 

Year of Graduation/Certification 19 7 

If this person did not teach in your school district during 1971-72, please check here 

and return: If you know what USD this person taught in, please list the number 

Subject Field (s) taught; , 

Listed below are several of the objectives that we hope teachers acquire from our program. 
Please read each of the items below and then using the following codes, give your evalu- 
ation. 

Excellently-4; Well-3; Average-2; Fair-1; No Inf ormation-O 

Compared witli teachers prepared at other institutions (with the same experience), I would 
say that the former student named above: 

1. comprehends (competently) institutional behavior and its effects on those 

persons who work in institutions. 

2. understands what happens to people when their behavior is changed, as well 

as how to achieve such (desired) change. 

3. understands and effectively utilizes oral and written cotnmunlcatlon skills. 

4. relates to and understands the non- teaching (exter nal-to- the-class-room) 

behavior of students, colleagues, parents, and administrators. 

5. exhibits competency in his/her subject discipline. 

6. possesses the ability to devise proper evaluative procedures. 

7. exhibits a sense of humor. 



8. exhibits adequate classroom control. 

9. responds in a professional manner to advice and criticism. 

;_10. possesses initiative and creativity necessary for competent instruction. 

11. exhibits the ability to be flexible and willingness to bring about innovative 

change . 

12* has the ability to fit in as part of the total school program. 

I would recommend him or her for employment: YES NO . 

Person has signed a contract for the 1972-73 year in your district: YES NO^ . 

(continued) 

erJc 
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Please return as soon as possible in the self -addressed, stamped envelope provided. 
Thank you for your help. 

NAME (print) 

TITLE 



USD # 
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Dirocior of Institutional Research 



HAYS. KANSAS 67601 



FORT HAYS KANSAS STATE COLLEGE 



Telephone 913 628-5880 




June 14, 1972 



Dear Kansas School Administrator: 

In ordar that the teachers prepared at Fort Hays Kansas State College will 
continue to be among the best-qualified, we are conducting a study to eval- 
uate the taacher- training program at our institution. Enclosed you will 
find a one and one-half page questionnaire and check list. We would appre- 
ciate your raking a few minutes to complete and return it in the enclosed, 
stamped envelope within the next few days and no later than July 1. 

To make this evaluation, a random sample of graduates in elementary or sec- 
ondary education were chosen so that we might contact the school systems in 
which they were employed for the 1971-72 school year. Our records indicate 
the person named on the enclosed evaluation sheet taught at your school or 
within your school system during the past year; we are asking your help ia 
determining the level of performance exhibited by this person. 

If you cannot personally give such an evaluation, we ask that the evaluation 
sheet be given to that administrator who supervises the teacher and knows 
the quality of his or her work. If, in fact, the person did not teach with- 
in the school system, please so indicate on the next page and return the 
questionnaire to us. 

We hope to use the results of the evaluation to improve current programs and 
to make plans for future program development. 

Your responses will be kept confidential and only the sujimiary of responses 
from all graduates will be published. 

Thank you for your time and effort. Without your help and the information 
only you can afford us, it would be impossible to complete the evaluation. 

Sincerely, 



Michael 0. Stewart 

Director of Institutional Research 





Department of Education 
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FORT HAYS KANSAS STATE COLLEGE 
Department of Education 
Office of Institutional Research 



RATING SCALE FOR TEACHER EDUCATION PROGRAMS 
Elementary Education 



Name . 

Year of Graduation/Certification 197 



If tliis nerson did not teach in your school district during 1971-72, please check here 
and return: If you know what USD this person taught in, please list the number 



Listed below are several of the objectives that we hope teachers acquiia from our program. 
Please read each of the items below and then using the following codes, give your evalu- 
ation. 

E:>:cellently-4; Well-3; Average-2; Fair-1; lie Information-O 

Compared with teachers prepared at ot';.er institutions (with the same experience), I would 
say that the former student named above: 

1. applies subject-matter knowledge effectively. 

2. identifies the characteristics of how children learn and grow. 

m 

3. demonstrates knowledge of the elementary school as a social institution* 

-r, knows and identifies learning theories, 

5. utilizes appropriate lesson plans. 

6. strives to attain pre-set and realistic goals. 

speaks and writes appropriate English in all situations. 

solves ' iw- ;room behavior problems. 

9. selects appropriate methods/ techniques while reacting and relating to children. 

IC. associates (competently) material gained from content methods courses. 

11. evaluates and utilizes research in education. 

12. concitrucrs and utilizes appropriate examinations and other evaluative tools. 

* 13. understands and analyzes the varying forms of current public school organization. 

14. maintains appropriate and accurate student records. 

15. chooses and lists children's library books to supplement content areas. 

16. cooperates effectively with other teachers, administrators and parents. 

(continued) 
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I wuuld recommend him or her for employment: YES N O 

Pi'.rson has signed a contract fox the 1972-73 year in your district: YE S N0_ 
Additional conments: 



Please return as soon as possible in the self -addressed, stamped envelope provided. 
Thank you for your help. 

NAME (print) 

TITLE 

USD # 



